Skip to content

feat: correctly propagate storage_options#514

Merged
tchaton merged 2 commits intoLightning-AI:mainfrom
deependujha:feat/propagate-storage-options
Mar 20, 2025
Merged

feat: correctly propagate storage_options#514
tchaton merged 2 commits intoLightning-AI:mainfrom
deependujha:feat/propagate-storage-options

Conversation

@deependujha
Copy link
Collaborator

Before submitting
  • Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure to update the docs?
  • Did you write any new necessary tests?

What does this PR do?

Fixes # (issue).

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

@deependujha deependujha marked this pull request as ready for review March 14, 2025 07:15
@codecov
Copy link

codecov bot commented Mar 14, 2025

Codecov Report

Attention: Patch coverage is 76.92308% with 9 lines in your changes missing coverage. Please review.

Project coverage is 79%. Comparing base (a2b2570) to head (53c5044).
Report is 2 commits behind head on main.

Additional details and impacted files
@@         Coverage Diff         @@
##           main   #514   +/-   ##
===================================
- Coverage    79%    79%   -0%     
===================================
  Files        39     39           
  Lines      5859   5862    +3     
===================================
+ Hits       4621   4623    +2     
- Misses     1238   1239    +1     
🚀 New features to boost your workflow:
  • Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Collaborator

@tchaton tchaton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mind adding a few tests ?

@deependujha
Copy link
Collaborator Author

deependujha commented Mar 20, 2025

Hi @tchaton
Creating a conftest fixture for fs_provider for different providers (s3, gs for now) will help test different functions map, optimize, merge_datasets across cloud providers.

And, also testing for if storage_options are being correctly propagated.

It'd be best to have it in the next pr.

@tchaton tchaton merged commit 23b05ed into Lightning-AI:main Mar 20, 2025
27 of 29 checks passed
@deependujha deependujha deleted the feat/propagate-storage-options branch March 20, 2025 09:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants